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APPARATUS AND METHOD FOR 3D ELECTRONIC PROGRAM GUIDE 

NAVIGATION 

FIELD OF THE INVENTION 

[0001] The present invention relates generally to recording television programs. 
More particularly, the present invention relates to user interfaces for displaying electronic 
program guide information. 

BACKGROUND OF THE INVENTION 

[0002] Electronic program guides (EPGs) are used to display information about 
television programs. An EPG is used to list current and scheduled television programs. 
EPGs may also include a short summary or commentary for each program. 

[0003] FIG. 1 illustrates a conventional EPG user interface for displaying EPG data. 
Conventional EPGs typically have an array or grid displayed on two different axes. As 
shown in FIG. 1, the horizontal axis is the time axis and the vertical axis is a channel axis for 
displaying the title of programs offered at specific times on the channels. Interactive EPGs 
also permit a user to select a title to access other functions, such as obtaining additional 
program information, changing the channel to the program, or setting up a recording session 
to the program. 

[0004] Conventional EPGs have several limitations. First, as the number of television 
channels increases, a conventional EPG becomes slow and awkward for television viewers to 
navigate, since they must scroll through a large number of television channels. Second, the 
advent of digital video recorders (DVRs), also known as personal video recorders (PVRs), 
permits users to store a large number of recorded programs. Thus, users increasingly need to 
navigate back and forth between an EPG for current and scheduled programs and a menu of 
stored video files. 

[0005] Moreover, television viewers face navigation challenges associated with the 
user interface. Users commonly view television from ten feet or more away from the screen 
and navigate the EPG with a handheld remote control. There is only so much information 
that can be comfortably viewed at a distance from a television screen. Images that are too 
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small for distance viewing may create an unpleasant user experience. Therefore, what is 
desired is a user interface with improved navigation functionality for EPG data and PVR 
data. 

SUMMARY OF THE INVENTION 

[0006] The present invention includes a system, method, and graphical user interface 
for displaying media information as a navigable three-dimensional image to facilitate a user 
selecting program information. In some embodiments, the three dimensional image may 
include: combinations of planar surfaces, cylindrical surfaces, spherical surfaces, or surfaces 
having a non-linear scale, such as a logarithmic scale. The media information may include an 
electronic program guide (EPG) associated with current and scheduled upcoming television 
channels, information associated with stored video files, such as personal video recorder 
(PVR) guide for stored video files, video file buffer information, or other types of media files. 

[0007] One embodiment of a method includes displaying a first type of program 
information on a first surface, and displaying a second type of program information on a 
second surface, wherein program information of at least two types is displayed as a three- 
dimensional image. 

[0008] One embodiment of a graphical user interface includes a first surface for 
displaying an EPG and a plurality of objects for representing information for stored files 
disposed on another surface, wherein the first surface and the other surface form a three- 
dimensional image. 

[0009] One embodiment of a system includes a computer receiving electronic 
program information, a graphics processor coupled to the computer for forming three- 
dimensional graphical images on a visual display, and a personal video recorder coupled to 
the computer for storing video files, the computer configured to display a three-dimensional 
image of electronic program guide information and objects representing stored video files 
such that a user may move the three-dimensional image to navigate through program 
information. 

[0010] One aspect of embodiments of the present invention is that program 
information is presented as a navigable three-dimensional image that may be moved to reveal 
additional program information. This also permits contextual visual clues, such as partially 
hidden surfaces, to be displayed to assist a user to avoid becoming confused when navigating 
program information for a large number of television channels or stored video files. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
[0011] The invention is more fully appreciated in connection with the following 
detailed description taken in conjunction with the accompanying drawings, in which: 
[0012] FIG. 1 illustrates a prior art EPG; 

[0013] FIG. 2 is a block diagram of a system in accordance with one embodiment of 
the present invention; 

[0014] FIGS. 3 is a flowchart illustrating one embodiment of a method in accordance 
with one embodiment of the present invention; 

[0015] FIGS. 4A-4F illustrate aspects of exemplary three-dimensional surfaces for 
displaying program information; 

[0016] FIG. 5 is a flowchart , illustrating another method in accordance with an 
embodiment of the present invention; 

[0017] FIG. 6 illustrates a three dimensional image representing EPG and PVR data 
and an associated axis of rotation for the image; 

[0018] FIG. 7 illustrates a three dimensional image displayed on a media player 
having an EPG surface and a PVR surface; 

[0019] FIG. 8 illustrates rotation of the image of FIG. 7 to display PVR drawers of 
content; 

[0020] FIG. 9 illustrates the opening of a drawer of content of FIG. 8; 

[0021] FIG. 10 illustrates the display of a menu list for displaying program 
information for an opened drawer of content of FIG. 9; 

[0022] FIG. 11 illustrates the display of a polyhedron having media thumbnails for 
displaying program information for an opened drawer of content of FIG. 9; 

[0023] FIG. 12 illustrates an embodiment of a spherical EPG displayed on a media 

player; 

[0024] FIG. 13 illustrates opening a region of interest of the spherical EPG of FIG. 12 
to reveal EPG information; 

[0025] FIG. 14 illustrates an embodiment for displaying program information for a 
video fill buffer on a media player; 

Like reference numerals refer to corresponding parts throughout the several views of 
the drawings. 
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DETAILED DESCRIPTION 

[0026] FIG. 2 shows an exemplary system 200 for presenting program information, 
such as an electronic program guide (EPG), and a personal video recorder (PVR) guide, as 
three-dimensional images. System 200 has audio-visual devices that include a television 
receiver 209 and a PVR 212 (also known as a digital video recorder). Television receiver 
209 receives a television signal and EPG data providing program information, such as from a 
satellite signal or a cable STB. PVR 212 includes a memory for storing audio-visual files, 
such as MPEG-2 compressed video files in digital format. Stored audio-visual files have 
associated program information. For example, stored audio-visual files may have program 
information input by a user or obtained from EPG data. Additionally, in some embodiments 
PVR 212 may store video files not directly recorded from television, cable, or satellite 
delivery, such as video files loaded from a DVD or downloaded from the Internet. For this 
case, the program information may be input by a user or obtained from metadata associated 
with the digital video file. Other types of audio-visual devices, such as a DVD player 210 or a 
CD player 114 may also be optionally included in the system 200. 

[0027] The audio-visual devices are coupled to a personal computer (PC) 216 or other 
controller having a central processing unit 232. PC 216 includes a graphical processor unit 
(GPU) 202 for generating three-dimensional images responsive to commands from CPU 232 
and a software driver 204 for interacting with the audio-visual devices. A tuner box 208 
communicatively coupled to PC 216 permits commands from a remote control 214 to be 
input to PC 216. Remote control 214 may, for example, be a multi-function remote control 
that permits the user to switch between different types of audio-visual devices via button 
mapping software 206. Remote control 214 includes control surfaces, such as arrow keys or 
mouse buttons, to navigate through an image on display 202 and to enter commands to select 
portions of the image. 

[0028] System 200 may be implemented in several different ways. In one 
embodiment, system 200 is implemented as a TV tuner card inserted into a PC. In this 
embodiment the TV tuner card may include a graphics processor chip, DMA engine for 
importing compressed A/V (as is the case of satellite content delivery), MPEG encoders for 
digitally recording video files, interfaces for communicating between the card and a 
television and/or other media devices, and memory for recorded video. An example of such a 
TV card is the Personal Cinema® card developed by the Nvidia corporation of Santa Clara, 
California. Alternatively, it will be understood that all or part of system 200 may be 
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implemented as a set-top box. For example, the functionality of computer 216 may be 
integrated into a stand-alone digital video recorder or as part of a television having built-in 
digital video recording capability. 

[0029] PC 216 includes a 3D EPG 290 module to generate a navigable three- 
dimensional image 282 representing program information on display device 202. In one 
embodiment, the 3D EPG module 290 is implemented as executable instructions stored in a 
local memory for processing by GPU 202. In one embodiment, 3D EPG module 290 is 
written in a high-level graphics language, such as the Cg language. The Cg language 
developed, in part, by the Nvidia Corporation, is a programming language that facilitates 
implementing various graphics effects. 

[0030] FIG. 2 illustrates a three-dimensional image 282 of an EPG which is a cylinder 
having channels displayed on a vertical axis and time display along the circumference of the 
cylinder. 3D EPG module 290 may be configured to act in response to commands input from 
a remote control 214, computer mouse, or other user input device that communicates 
commands to PC 216. 

[0031] In the present invention, three-dimensional images representing program 
information are rendered to present program information, such as EPG or a guide to stored 
video files. Additionally, three dimensional transition effects may be used to assist a user to 
navigate EPG and PVR data without losing their context. In one embodiment, the three- 
dimensional image 282 is navigable in that commands input by a user permit the three- 
dimensional image to be moved, i.e., translated, rotated, or scaled such that the viewpoint of 
the image appears to change to reveal portions of the image initially hidden from view. In 
another embodiment, the three-dimensional image is navigable in that a user may select 
regions of the three-dimensional image to access additional two-dimensional or three- 
dimensional representations of program information. As described below in more detail, in 
some embodiments one surface of the three-dimensional image represents a first type of 
program information and a second surface represents another type of program information. 

[0032] FIG. 3 is a flowchart illustrating a general method of the present invention. In 
one embodiment, media information is displayed 305 as a three-dimensional image that may 
include an EPG, PVR data, or both an EPG and PVR data. A three-dimensional image 
representing program information is displayed 305. The viewpoint of the image is adjusted 
310 in response to a user command, permitting the user to navigate the three-dimensional 
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image. In response to a user input, a region of interest of the three-dimensional image is 
opened 315 to permit a user to obtain additional information about a program of interest. 

[0033] FIGS. 4A-4F illustrate some exemplary three-dimensional image types for 
displaying program information. In one embodiment, the three dimensional image includes 
at least a first planar surface 405 and a second planar surface 410, as illustrated in FIG. 4 A. 
For example, one planar surface 405 may be used to represent EPG data and the other surface 
410 used to represent PVR data. Rotation or translation of the image may be used to increase 
the visibility of one of the surfaces with respect to the other, where a surface contains either 
data information or visual information. 

[0034] In another embodiment, the three dimensional image includes a non-planar 
curved surface, such as illustrated by the cylinder of FIG. 4B. Rotation and/or translation of 
the curved surface 415 with respect to an axis 420 may be used to bring regions of interest 
into view on surface 415. For example, program information may be displayed on a vertical 
channel axis and a time axis displayed on the circumference of the cylinder. Alternatively, a 
vertical axis may be used to display general categories of content and sub-categories of 
content may be displayed in surfaces regions corresponding to portions along the 
circumference. Additionally, as described below in more detail, the circumference of the 
curved surface may include media thumbnails (e.g., still or moving images) representing 
program information. Some of the benefits of using a curved surface, such as a cylinder or 
sphere, are that it provides a visually inclusive and intuitive graphical interface that permits a 
user to navigate content of interest to the center of the viewpoint. 

[0035] For embodiments with curved surfaces, in some embodiments when the cursor 
is placed on the curved surface it is mapped to a local coordinate system on the curved 
surface to facilitate navigation of the curved surface. Additionally, in one embodiment by 
selecting a portion of the curved surface a point on the curved surface may be grabbed to 
initiate rotation of the curved surface. Additionally, in one embodiment 3D animation may 
be used to move objects from the broad view to a focused view. 

[0036] In still yet another embodiment, the three-dimensional image may comprise a 
polyhedron 430, such as a cube, as illustrated in FIG. 4C, having a plurality of exposed facets 
435-A, 435-B, and 435-C along with one or more facets hidden from view due to the 
viewpoint. Rotation of the image with respect to an axis 440 reveals different facets of the 
polyhedron. In one embodiment described below in more detail, each facet of a polyhedron 
may have a media thumbnail associated with it (e.g., a still or moving image). 
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[0037] Alternatively, the three-dimensional image representing program information 
may comprise a more complex image, such as a representation of rows 485 of videocassettes 
495 (e.g., with cover art or screen shots) arranged by content to represent a video rental store, 
as illustrated in FIG. 4D. In this example, adjusting the viewpoint may be used to emulate the 
experience of walking through a video store while viewing displayed video-cassettes or 
DVDs. Each representation of a videocassette 495 may include a media thumbnail (e.g., a 
still image, a moving image, or a movie trailer) to represent the stored video file. 

[0038] Referring to FIGS. 4E and 4F, one aspect of the present invention is that 
rotation and/or translation of a three-dimensional surface may be used to obtain coarse tuning 
and fine-tuning. In navigating a large number of channels and/or stored files a user may want 
to have two different levels of detail presented. For retaining context of navigation, a low 
level of detail is desired. However, for searching channels/files of interest, a higher level of 
detail is desirable. Referring to FIG. 4E, in one embodiment rotating a three-dimensional 
surface in a first direction (e.g., in the x-y plane) results in coarse tuning whereas rotating in a 
second direction (e.g., in the x-z plane) results in fine-tuning. In some embodiments, 
geometric effects are used to make program information within certain ranges have a larger 
apparent size. In one embodiment, illustrated in FIG. 4F, at least one axis of the surface has a 
non-linear scale. For example, the channel axis may have each progressive range, n, of 
channels afforded a smaller amount of screen space by either changing the scale of 
presentation or by curving the surface away from the user to cause an apparent reduction in 
size of selected channel ranges. 

[0039] FIG. 5 is a flowchart illustrating in more detail one embodiment of a method 
of the present invention. In this embodiment, EPG data is displayed 505 on a first surface 
and PVR data is displayed as objects along a second surface. The viewpoint of the image 
may be adjusted 510 in response to a user input, such as by rotating the image. A region of 
interest selected by a user is opened 515 to display additional program information, either as 
a two-dimensional or three-dimensional representation of additional program information. 

[0040] A method of navigating EPG and PVR data is further illustrated in regards to 
FIGS. 6-11. Referring to FIG. 6, in one embodiment information on past programs (i.e., 
stored PVR programs) is displayed on one surface and EPG information for present/future 
programs is displayed on another surface. An EPG is displayed as a user interface 600 
having a first surface 605 having a channel axis 610 and a time axis 615. In one embodiment 
a user may select the time scale of interest, such as by day, week, or month. More generally, 
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electronic program guide information may also be displayed on a surface in which at least 
one of the channel and time axes has a non-linear scale, such as a logarithmic time scale. 
For example, a non-linear time scale may be used to emphasize time intervals close to the 
present time. Alternatively, a non-linear channel scale may be used to emphasize certain 
channels, such as a logarithmic channel scale. 

[0041] PVR program information for stored video files is displayed on a second 
surface 620. Second surface 620 may include categories 630 of content for classifying stored 
content. In one embodiment, the first surface 610 and second surface 630 are orthogonal to 
each other, such that they form an x-y plane and an orthogonal x-z plane connected at an axis 
635. In one embodiment, within each plane, objects can emerge in the third dimension to 
emulate a drawer opening. 

[0042] One benefit of the three-dimensional representation is that a user may view 
both EPG data and PVR data simultaneously. Additionally, in one embodiment, a user may 
input commands to rotate the image about an axis 635 to provide a better view of EPG data or 
PVR data, depending upon the preference of the user. The ability to move the three 
dimensional image provides, among other benefits, an improved capability for a user to 
access a large amount of EPG/PVR data without losing their orientation and context. 

[0043] FIGS. 7-1 1 are exemplary screen shots illustrating navigation of a three 
dimensional image of EPG and PVR data similar to that of FIG. 6. As illustrated in FIG. 7, a 
three dimensional image 710 representing EPG data and PVR data may be displayed on a 
media player window 705. In this example, the EPG data is represented on a channel vs. time 
surface 720. A user may navigate the EPG using a user interface to move a cursor across the 
surface of the EPG and select individual programs. PVR data is represented on the second 
surface 730 by objects representing categories of content and associated sub-categories. For 
example, the objects may include general categories 740 for sports, travel, and movies 
arranged into subcategory objects 750 of content across second surface 730. Note that in the 
screen shot of FIG. 7 that the viewpoint is such that the EPG surface faces the user face-on. 

[0044] Referring to FIG. 8, in response to a user command, image 710 is rotated such 
that the PVR surface 730 is presented face-on to the user. Thus, by comparing FIGS. 7 and 8 
it can be seen that navigation of EPG data and PVR data is facilitated by the ability to change 
the viewpoint with respect to the image, i.e., by rotating the image. Additionally, contextual 
information is provided that aids a user to maintain their orientation. First, rotation provides 
a visual cue of the change from viewing EPG data face-on to viewing PVR data face on, and 
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vice-versa. Second, when one of the surfaces is viewed face-on, the viewpoint is selected 
such that a partial view of the other surface is maintained, providing a visual clue to the user 
which may, for example, assist a user to switch back and forth between viewing EPG data 
and PVR data (e.g., recorded content) while maintaining their orientation. 

[0045] Referring to FIG. 9, in one implementation, the objects 750 representing 
subcategories of PVR data are drawers of content. A drawer may represent a sub-category 
of content by subject matter. Alternatively, a drawer could represent other ways to organize 
sub-categories of content, such as by genre, television series, by actor, or by date. A user 
may scroll through the drawers (e.g., through commands input by a remote control) and input 
a command to select a drawer. A selected drawer 750-i opens to access additional 
information regarding the stored video files. 

[0046] Referring to FIG. 10, in one embodiment, opening a drawer 750-i results in the 
display of a two-dimensional representation of content, such as a list of titles of stored 
content opening up for the sub-category. A user may then select a title to obtain more 
information or to open up the associated content. 

[0047] Alternatively, opening a drawer 750-i may generate a three-dimensional image 
appearing to represent attributes of one or more stored video files. As illustrated in FIG. 1 1, a 
drawer may open to reveal a pop-up 1105 representation of a three-dimensional surface to 
display information about the content, such as a polyhedron having media thumbnails 1110 
associated with each facet of the polyhedron, such as on each face of cube. The media 
thumbnails may be an audio thumbnail (e.g., a short audio clip) or a video-thumbnails (e.g., a 
static frame or a short video clip or loop), such as DVD cover art. 

[0048] In one embodiment, a user selects the media thumbnail for stored video files 
using a button on a remote control. Alternatively, the media thumbnail may be selected 
automatically by software. For example, the exemplary polyhedron 1105 shown in FIG. 11 
has media thumbnails comprising still images on each facet 1110. The images, may, for 
example, be selected automatically, such as by selecting title images and/or other images 
from a video file. 

[0049] As previously discussed, program information may be displayed on a non- 
planar surface, such as a curved surface. Referring to FIG. 12, in one embodiment, EPG data 
is displayed on the surface of a sphere 1210. A user may then select a region of interest on 
the sphere to obtain detailed program information 1310, as indicated in FIG. 13. Note that a 
cursor 1220 can be displayed on the local coordinates of the surface of the sphere. In one 
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embodiment, a user may enter a select command to "grab" the point at the center of the 
cursor and move the sphere about that point (e.g., rotate the sphere to translate the selected 
point). This permits a "random access" method of display in which a surface may be easily 
rotated to reveal regions of interest to the user. 

[0050] Another aspect of curved surfaces such as the sphere of FIG. 12 relates to the 
apparent size of regions of the curved surface. Each portion of a curved surface faces a user 
at a different angle and at a different offset (in model space) from the user. Regions of the 
sphere that, in model space, are closest to the viewpoint and/or directly facing the viewer 
appear to have a larger area. Thus, some types of information (e.g., pictures and large font 
text) may be visible on all regions of the sphere whereas other types of information (e.g., 
small font text) may be visible only on regions of the sphere brought directly facing the user. 
This permits the level of detail to be sufficient for a user to preserve context while they 
navigate the curved surface while also efficiently using screen space. Additionally, it allows 
random access to all programs at all times. 

[0051] Embodiments of the present invention include a three dimensional image 
having media thumbnails arranged to represent a time sequence of content, such as a video 
file buffer or a live pause buffer. PVRs commonly include a time shift buffer or a live pause 
buffer. Referring to FIG. 14, media thumbnails 1405 may be arranged in a time sequence, 
such as a sequence arranged as a disc or cylinder 1420. In this embodiment, each media 
thumbnail 1405 may correspond to an instant in time of a video file buffer (e.g., one image 
per pre-selected unit of time to represent the flow of content within the video file buffer). A 
user may then input a command to rotate disc 1420 to bring a media thumbnail into view, 
such as by selecting a rotation arrow 1430. Additionally, a polyhedron 1450 having media 
thumbnails to represent program information for the video file may also be presented. 

[0052] In some embodiments, a user may request one or more calendar panes to be 
displayed for EPG data. In one embodiment, a user may define the time and channel 
attributes of the calendar pane. In some embodiments a user selects a portion of an EPG 
surface and then may request that a calendar pane be opened to show EPG data in more detail 
for the selected portion of the EPG surface. 

[0053] It will be understood that in addition to other embodiments, the software for 
displaying three-dimensional program information may also be provided as a software 
upgrade, such as software embodied in a storage medium of available through a signal- 
bearing medium, such as software downloadable from the Internet. Consequently, an 
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embodiment of the present invention relates to a computer storage product with a computer- 
readable medium having computer code thereon for performing various computer- 
implemented operations. The media and computer code may be those specially designed and 
constructed for the purposes of the present invention, or they may be of the kind well known 
and available to those having skill in the computer software arts. Examples of computer- 
readable media include, but are not limited to: magnetic media such as hard disks, floppy 
disks, and magnetic tape; optical media such as CD-ROMs and holographic devices; 
magneto-optical media such as optical disks; and hardware devices that are specially 
configured to store and execute program code, such as application- specific integrated circuits 
("ASICs"), programmable logic devices ("PLDs") and ROM and RAM devices. Examples of 
computer code include machine code, such as produced by a compiler, and files containing 
higher-level code that are executed by a computer using an interpreter. For example, an 
embodiment of the invention may be implemented using Java, C++, or other object-oriented 
programming language and development tools. Another embodiment of the invention may be 
implemented in hardwired circuitry in place of, or in combination with, machine-executable 
software instructions. 

[0054] The foregoing description, for purposes of explanation, used specific 
nomenclature to provide a thorough understanding of the invention. However, it will be 
apparent to one skilled in the art that specific details are not required in order to practice the 
invention. Thus, the foregoing descriptions of specific embodiments of the invention are 
presented for purposes of illustration and description. They are not intended to be exhaustive 
or to limit the invention to the precise forms disclosed; obviously, many modifications and 
variations are possible in view of the above teachings. The embodiments were chosen and 
described in order to best explain the principles of the invention and its practical applications, 
they thereby enable others skilled in the art to best utilize the invention and various 
embodiments with various modifications as are suited to the particular use contemplated. It 
is intended that the following claims and their equivalents define the scope of the invention. 
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